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ACCEPTABILITY  OF  ASSOCIATE  EVALUATION  IN  NATIONAL  GUARD  WITS 


Associate  ratings  have  been  used  by  the  U.S.  Armv  as  a  measure  of 
ability  or  leadership  In  a  variety  of  training  situations.  Peer  evalua¬ 
tions  have  been  found  to  be  reliable  and  valid  predictors  of  performance 
In  training  contexts  (Downey  and  Duffy,  1975).  Reliability  coefficients 
have  consistently  been  In  the  range  of  .70  to  .90,  and  the  validity  of 
the  ratings  has  been  found  equal  to  or  higher  than  that  of  other  measures 
which  have  been  used  (Bolton,  1971;  Downey,  1974,  1975;  Downey,  Medland, 
and  Yates,  1976). 


Given  the  nature  of  the  training  environments  In  which  associate 
ratings  have  been  used — class  size  units  during  most  of  the  training 
time — and  the  use  of  computerized  scoring  techniques,  peer  ratings  have 
been  found  to  be  feasible.  They  can  be  administered  and  scored  with 
little  disruption  to  routine.  A  possible  drawback  with  the  technique  Is 
that  Individuals  who  take  part  In  the  evaluations  have  In  some  situations 
found  them  to  be  an  unacceptable  form  of  assessment  (Downey,  1975;  Mohr, 
1975).  Downey  (1976)  found  that  Ranger  students  felt  that  thev  could 
evaluate  the  leadership  potential  of  their  classmates  but  preferred  not 
to  have  peer  ratings  Included  In  their  records.  A  large  sample  of 
students  In  Officer  Basic  Courses  (OBC)  at  various  service  schools 
reported  that  thev  felt  that  their  experiences  and  observations  were  an 
Inadequate  basis  for  judging  others'  abllltv.  Their  attitudes  about  use 
of  the  ratings  were  less  negative,  but  thev  still  felt  It  would  be  un¬ 
acceptable  to  use  ratings  for  career  decisions  (Mohr,  1975). 

All  the  research  reported  above  was  conducted  in  training  environ¬ 
ments,  and  for  the  most  part  the  participants  were  officers.  The  high 
validity  and  reliability  that  associate  evaluation  has  demonstrated  make 
the  technique  potentially  valuable  as  an  added  measure  for  use  in  making 
personnel  decisions  In  combat  and  combat  support  units.  However,  the 
situational  constraints  in  training  differ  from  those  in  line  units,  and 
the  applicability  and  acceptability  of  peer  evaluation  In  the  two 
settings  could  lead  to  very  different  conclusions  about  the  use  of  such 
evaluations . 


OBJECTIVES 

The  present  research  was  designed  to  assess  the  acceptability  of  a 
peer  evaluation  technique  among  enlisted  men  In  combat  and  combat 
support  units.  Specifically,  the  objectives  were  to  (1)  measure  soldier 
attitudes  toward  peer  evaluations  using  the  Unit  Associate  Rating 
Questionnaire  (UARQ) ;  (2)  gather  Information  regarding  the  relative 
acceptability  of  various  evaluation  techniques  for  use  in  making  decisions 
as  to  promotion  or  separation  from  the  service;  and  (3)  determine 
whether  non-tralnlng  units  pose  any  feasibility  problems  for  the  adminis¬ 
tration  of  associate  ratings. 
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METHOD 


SAMPLE 

Soldiers  participating  In  the  research  were  members  of  the  27th 
Brigade,  42d  Division  of  the  New  York  State  National  Guard.  The  research 
was  conducted  at  Fort  Drum,  N.Y.  during  the  27th  Brigade's  two-week 
annual  training  period.  However,  unlike  the  training  units  In  previous 
work  on  peer  evaluations  (Officer  Basic  Training  Course,  Arwv  Individual 
Training,  and  ROTC) ,  participating  units  were  regularlv  constituted 
National  Guard  units  whose  personnel  were  assigned  on  a  long-term  basis. 

The  five  platoons,  one  from  each  of  five  different  companies  of  the 
27th  Brigade,  were  representative  of  various  combat  and  combat  support 
units.  Table  1  shows  the  companies  and  number  of  Individuals  for  each 
platoon.  Because  the  research  procedures  were  carried  out  In  the  field 
during  breaks  in  the  schedule,  situational  factors  made  It  Impossible 
for  all  the  designated  soldiers  to  participate  In  the  procedures,  and 
resulted  In  smaller  Ns  than  were  anticipated.  A  total  of  79  enlisted 
men  were  Included. 


Table  1 

PLATOONS  SAMPLED  AND 
NliMBER  FROM  EACH 


Platoon  N 

Co.  D,  102nd  Medical  Battalion  19 

Co.  B,  l/127th  Armor  Battalion  11 

Headquarters  and  Headquarters  Co., 

l/108th  Infantry  20 

Co.  A,  l/174th  Infantry  17 

Combat  Support  Co.,  2/10Rth  Infantry  12 


VARIABLES 


Data  were  collected  using  three  separate  Instruments.  Soldiers 
first  filled  out  a  biographic  survey  form  designed  to  obtain  demographic 
Information  on  each  participant's  educational,  vocational,  and  military 
background.  The  form  also  contained  two  Items  which  asked  soldiers  to 
state  their  opinion  of  the  acceptability  of  various  assessment  methods 
used  in  the  military  for  decleiona  regarding  (1)  promotions  and  (2) 
separation.  Associate  rating  was  Included  as  one  of  the  assessment 
techniques.  The  various  techniques  were  then  rank  ordered  according  to 
how  desirable  they  were  thought  to  be  for  career  decisions. 

The  Guardsmen  next  participated  In  an  aasoclate  evaluation  procedure. 
As  used  here,  associate  evaluations  are  modified  full  nominations  where 
the  raters  are  required  to  choose  from  among  the  other  members  of  their 
platoon  the  six  soldiers  whom  they  consider  best  at  getting  the  Job 
done  and  the  six  soldiers  whom  they  consider  to  be  the  worst  at  getting 
the  Job  done.  These  choices  were  recorded  on  optical  scanning  answer 
sheets. 

Following  the  associate  evaluations  procedure,  participants  were 
required  to  complete  the  UARQ,  a  modified  and  expanded  version  of  the 
Associate  Rating  Questionnaire  (ARQ)  which  has  been  used  In  previous 
aasoclate  rating  research  on  officers  (Dovnev,  1975).  The  UARQ 
Incorporated  questions  from  the  ARQ  that  also  applied  to  enlisted  men; 

It  eliminated  Items  dealing  specifically  with  areas  peculiar  to  officers 
and  trainees.  The  UARQ  also  contained  an  extensive  number  of  Items 
related  to  the  National  Guard  climate.  The  present  analysis  focused  on 
opinions  about  the  validity  and  use  of  peer  ratine  techniques.  Speci¬ 
fically,  respondents  were  asked  about  their  attitudes  regarding  the 
ability  of  associates  to  produce  valid  ratings,  what  the  rating  scores 
should  be  used  for,  how  rating  scores  might  affect  their  day-to-day 
performance,  and  how  long  rating  scores  should  be  kept  on  an  Individ¬ 
ual's  record. 


ANALYSIS 

A  two-way  analysis  of  variance  with  repeated  measures  was  performed 
to  determine  If  differential  unit  membership  had  an  effect  on  responses 
to  the  UARQ.  Associate  evaluations  were  correlsted  with  attitude 
measures  on  the  UARQ  to  determine  If  anv  relationship  existed  between 
ratings  and  their  acceptability.  Another  correlational  analysis  was 
performed  between  peer  evaluations  and  self-evaluations.  Finally,  t_ 
tests  were  calculated  comparing  the  mean  response  for  each  item  against 
a  score  which  represented  a  neutral  opinion.  Significant  results  for 
any  of  the  t  tests  would  indicate  a  general  opinion  which  was  either 
positive  or  negative  toward  the  Item.  Also  presented  were  opinions 
about  various  methods  of  making  promotion  or  separation  decisions. 


RESULTS  AND  DISCUSSION 


The  associate  ratings  from  each  of  the  five  platoons  were  found  to 
be  highly  reliable,  and  within  the  range  reported  by  other  researchers 
(Hollander,  1957).  The  adfuated  split-half  reliability  coefficients 
ranged  from  a  low  of  .80  for  the  medical  platoon  to  .93  for  the  Infantry 
platoon. 

Associate  rating  scores  were  correlated  with  each  of  the  first  21 
UARQ  Items,  except  Items  17  and  18  which  were  self-ratings.  Associate 
rating  scores  were  also  correlated  with  the  rank  given  to  the  associate 
evaluation  technique  in  comparison  with  other  methods  of  making  promo¬ 
tion  or  separation  decisions.  None  of  the  coefficients  was  statis¬ 
tically  significant,  indicating  that  there  was  no  relationship  between 
attitudes  toward  peer  ratings  and  the  actual  associate  evaluation  score 
received.  The  fact  that  attitudes  and  ratings  were  independent 
Indicates  that  soldiers  answering  the  questionnaire  or  ranking  the 
various  personnel  decision  methods  must  not  have  taken  Into  account  how 
they  felt  their  own  evaluations  would  turn  out.  Respondents  evidently 
had  some  Idea  of  what  their  own  associate  ratings  would  be;  correlation 
between  associate  ratings  and  self-ratings  was  r  -  .41  (p  <  .01). 
Correlation  was  r  -  .4 f>  (p  <  .01)  between  associate  ratines  and  how 
respondents  estimated  others  would  rate  them. 

Tables  2  and  3  present  the  proportion  of  respondents  Indicating 
whether  various  personnel  decision  methods  are  acceptable  or  unaccept¬ 
able  for  promotion  or  separation  decisions,  and  the  ranking  of  each 
method  for  each  decision.  Associate  evaluations  were  considered 
acceptable  for  use  In  promotion  decisions;  however,  opinion  about  use 
of  the  ratings  in  separation  decisions  was  divided.  For  both  promotion 
and  separation  decisions,  associate  evaluation  was  ranked  In  the  middle 
of  the  distribution  of  methods.  With  the  exception  of  supervisors' 
ratings,  which  ranked  third  for  both  types  of  decision,  the  evaluation 
methods  that  were  ranked  above  associate  rating  have  an  obiective 
quality.  ’Evaluation  of  vour  work"  ranked  first  and  "Skill  Qualification 
Test"  ranked  second  for  both  decisions;  soldiers  seem  to  prefer  evalua¬ 
tion  based  on  performance.  The  high  ranking  of  "Supervisor's  rating" 
may  be  the  result  of  the  feeling  that  supervisors  are  In  the  beat  position 
to  evaluate  an  Individual's  work.  Other  Items  In  the  UARO  dealt  with 
attitudes  toward  supervisors  and  are  not  relevant  to  the  present 
analysis . 

Five  different  units  had  been  sampled  under  the  assumption  that 
various  combat  and  combat  support  units  might  view  the  acceptability  of 
associate  ratings  differently.  Table  4  presents  the  results  of  a  two- 
way  analvsl9  of  variance  to  determine  If  a  difference  between  units 
existed  In  responses  to  the  UARQ  ltens  1  through  20.  The  results  of  the 
analysis  Indicate  that  while  participants  responded  to  the  Items 
differentially,  there  was  no  significance  difference  between  responses 
of  the  five  platoons,  nor  was  the  interaction  between  items  and  units 
significant . 


Table  2 


RANK  I NC,  BY  SOLDIERS  FROM  BEST  (1)  TO  WORST  (11) 
METHOD  FOR  DETERMINING  PROMOTIONS;  AND 
PERCENTAGE  OF  SOLDIERS  INDICATING 
ACCEPTABILITY  OF  EACH  METHOD 


Rank 

Item 

Acceptable 

"Yes" 

a 

"No" 

1 

Evaluation  of  one's  work 

B9X 

lit 

2 

Skill  Qualification  Test 

83 

17 

3 

Supervisor's  ratlnR 

82 

18 

4 

Completion  of  professional 
development  training 

81 

19 

5 

Rating  by  one's  associates 

73 

27 

6 

MOS  test 

65 

35 

7 

Time  in  grade 

60 

40 

8 

Board  decision 

39 

61 

9 

Commander's  decision 

39 

61 

10 

Getting  assigned  slot  which  has 
higher  rank  associated  with  it 

33 

67 

11 

First  sergeant's  choice 

29 

71 

Table  3 

RANKING  BY  SOLDIERS  FROM  BEST  (1)  TO  WORST  (9)  METHOD 
FOR  DETERMINING  INVOLUNTARY  SEPARATION;  AND  PERCENTAGE 
OF  SOLDIERS  INDICATING  ACCEPTABILITY  OF  EACH  METHOD 


Acceptable : 


Rank 

Item 

"Yes" 

"Nrf‘ 

1 

Evaluation  of  one's  work 

89X 

11X 

2 

Skill  Qualification  Test 

78 

22 

3 

Supervisor’s  rating 

73 

27 

4 

Rating  by  one's  associates 

55 

45 

5 

MOS  test 

58 

42 

6 

Time  In  grade 

39 

61 

7 

Beard  decision 

55 

45 

8 

Commander's  decision 

47 

53 

9 

First  sergeant's  choice 

31 

69 

Table  4 


RESULTS  OF  TWO-WAY  ANALYSIS  OF  VARIANCE  FOR  I'ARQ 
ITEMS  1  -  20  AND  PARTICIPATING  PLATOONS 


Source 

Sum  of 
Squares 

df 

MS 

F 

Between  Subjects 


Platoons 

8.00 

3 

2.67 

.88  ns 

Subjects  within  Platoons 

195.81 

65 

3.01 

Within  Subjects 

Items 

142.53 

19 

7.50 

5.27  ** 

Items  x  Platoons 

75.22 

57 

1.32 

.93  ns 

Subjects  x  Platoons  x  Items 

1757.77 

1235 

1.42 

**  p  <  .001 
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Table  5  shows  the  means  and  standard  deviations  for  responses  to 
Items  1  through  21  of  the  UARQ,  excluding  Items  17  and  18  which  were 
handled  separately.  Also  Indicated  Is  whether  responses  deviated  signif¬ 
icantly  from  undecided  (a  score  of  3).  The  Appendix  presents  the 
proportion  of  respondents  who  chose  each  response  for  Items  1-21.  The 
overall  pattern  of  resulta  shove  a  positive  attitude  toward  the  use  of 
easoclete  ratings  as  a  part  of  soldlara'  records.  The  mean  values  for 
Items  1  and  2  Indicate  that  participants  In  this  study  felt  that  associate 
ratings  could  be  of  value  In  predicting  future  work  performance  and  that 
the  situations  upon  which  Judgments  were  made  In  this  case  were  adequate. 
The  very  positive  response  to  these  Items  Is  contradictory  to  the 
findings  of  Mohr  (1975)  In  Officer  Basic  Course  settings  where  raters 
were  asked  to  evaluate  leadership  potential.  Officers  there  felt  that 
associate  ratings  were  not  predictive  of  performance,  and  that  the 
situations  upon  which  a  rating  would  be  based  were  not  sufficient  for 
valid  and  reliable  ratings. 

Items  3,  4,  and  5  dealt  with  tha  effects  that  associate  evaluations 
might  have  on  performance  or  on  Interpersonal  relations  within  the  work 
unit.  Replies  Indicate  that  raters  were  undecided  about  the  effects  of 
peer  ratings.  Respondents  indicated  a  slight  disagreement  with  the  idea 
that  the  associate  evaluation  procedure  would  affect  Interpersonal 
relations  or  cause  an  Individual  to  work  harder. 

Items  6,  7,  8,  9,  and  10  addressed  various  aspects  of  the  premise 
that  a  person  can  Judge  which  members  of  a  group  of  associates  are  per¬ 
forming  well  and  which  are  performing  poorly.  Responses  to  Item  6  were 
relatively  positive,  indicating  that  although  one  mav  work  closely  with 
only  a  few  Individuals  one  can  still  Judge  the  effectiveness  of  most 
members  of  a  platoon.  (Content  of  Item  6  has  been  abbreviated  In  Table 
5.)  Responses  to  question  7  Indicated  agreement  with  the  Idea  that 
associate  ratings  should  be  based  on  long-term  association.  Responses  to 
item  8  were  also  positive  with  regard  to  Individuals  being  capable  of 
determining  who  was  not  performing  well.  Responses  to  Item  9,  which 
asked  If  peers  rate  friends  high  regardless  of  ability,  were  about 
evenly  divided  and  Indicated  that  In  many  cases  respondents  were  being 
objective  In  their  eveluatlons.  Item  10  showed  some  disagreement  with 
the  statement  that  not  many  people  could  Judge  the  performance  of  others, 
a  result  consistent  with  the  over-all  assessment  thet  individuals  are 
capable  of  making  rating  decisions,  given  a  long  enough  period  of  time 
working  together. 

Questions  11,  12,  13,  and  14  proposed  various  uses  for  associate 
ratings.  Respondents  seemed  to  be  undecided  about  what  specific  uses 
the  ratings  should  be  put  to,  although  positive  about  Including  ratings 
as  part  of  tha  total  record.  This  result  Is  consistent  with  the  finding 
reported  earlier  thet  pear  evaluation  was  acceptable  but  was  ranked  In 
the  middle  of  a  list  of  evaluation  methods.  Item  15  asked  respondents 
to  choose  how  long  an  associate  rating  should  remain  in  their  records, 
the  continuum  being  from  not  wanting  associate  ratings  to  be  In  the 
record  at  all  to  keeping  them  there  until  replaced  by  a  subsequent  rating. 


MEANS  AND  STANDARD  DEVIATIONS  AND  t-TEST  RESULTS 
FOR  ITEMS  1  -  21  OF  THE  UARO 


The  mean  response  was  between  keeping  them  till  promoted  and  keeping  them 
Indefinitely,  with  decreasing  weight  over  time.  The  reply  to  thle  Item 
also  contraeta  with  Mohr's  (1975)  results  In  which  officer  basic  students 
overwhelmingly  preferred  not  to  have  the  scores  In  their  records. 

The  final  Items  of  the  peer  evaluation  section  of  the  UARO  asked 
effect  periodic  associate  ratings,  If  used  In  career  progression 
decisions,  would  have  on  morale,  cohesiveness,  and  work  output. 

Responses  were  positive  with  respect  to  both  morale  and  work  output  but 
Indicated  that  ratings  would  have  no  effect  on  cohesiveness.  Responses 
to  later  UAR Q  Items  Indicated  that  coheslveneae  was  already  quite  high. 

The  resulte  of  the  present  research  are  inconsistent  with  those  found 
by  Mohr  (1975)  using  officer  basic  students,  In  which  strong  negetlve 
feelings  were  expressed  toward  associate  evaluation  as  an  acceptable 
technique.  An  explanation  for  this  marked  difference  In  results  lies  In 
the  nature  of  the  settings  In  which  the  studies  took  place.  An  Officer 
Basic  Courae  brings  together  a  diverse  group  of  Individuals  who  are 
learning  how  to  adjust  to  a  new  life  stvle.  During  the  OBC  period, 
officers  are  expected  to  learn  manv  of  the  skills  that  they  will  be 
called  upon  to  use  during  the  rest  of  their  military  careers.  The 
introduction  of  the  associate  evaluation  procedure  Into  this  adjustment 
and  learning  period  was  evidently  felt  to  be  Inappropriate  by  the  OBC 
students  who  participated  in  the  evaluations  and  also,  as  Mohr  reports, 
by  the  school  personnel,  who  treated  the  evaluation  procedure  as  an 
added  chore.  In  the  National  C.uard,  evaluation  is  expected  by  the 
trainees  and  is  carried  out  bv  first  sergeants  and  commanders.  It  la 
therefore  not  unexpected  that  Guardsmen  favored  having  their  associates, 
who  are  In  many  cases  their  friends,  rate  them. 

The  difference  In  Impact  of  the  ratings  between  officers  in  training 
and  anllated  men  might  also  explain  whv  Downey  (1975)  found  that  when  he 
manipulated  Instructions  about  associate  evaluation,  those  officers  who 
responded  with  positive  attitudes  on  the  ARQ  tended  to  have  received  high 
retlng  scores  from  their  associates.  The  Officer  Basic  Course  students 
who  felt  they  could  benefit  were  most  probably  more  willing  to  express 
positive  opinions  about  associate  ratings.  In  the  present  research, 
although  associate  ratings  were  accepted,  there  was  no  relationship 
between  attitudes  and  rating  scores.  Guardsmen  are  possibly  less 
threatened  by  evaluation,  and  therefore  can  more  freely  express  their 
opinions,  independent  of  the  outcome  of  the  evaluation. 


CONCLUSIONS 


Generally ,  tha  National  Guardsman  who  participated  In  the  present 
research  demonstrated  willingness  to  accept  associate  evaluation  as  a 
part  of  their  records.  This  positive  reeponse  was  Inconsistent  with 
negative  attitudes  shown  toward  peer  evaluation  by  officers  in  training 
situations. 
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Host  of  the  Guardsmen  felt  that  associate  evaluations  could  predict 
future  performance  and  should  be  made  part  of  Individual  records.  They 
also  felt  that  they  had  enough  experience  with  the  men  they  were  rating 
to  he  able  to  make  valid  decisions.  Guardsmen  were  undecided  about 
specific  uses  for  ratings,  especially  If  the  ratings  were  to  be  used  for 
separation.  Some  opinions  were  expressed  that  use  of  rating  scores  In 
making  career  progression  decisions  would  have  a  positive  effect  on 
morale  and  work  output. 

A  problem  that  occurred  repeatedly  and  that  would  probably  occur  In 
most  non-tralnlng  situations  was  the  impossibility  of  coordinating 
schedules  so  that  all  those  who  were  to  participate  In  the  data  collec¬ 
tion  were  actually  present.  The  present  study  was  conducted  during 
the  annual  training  period  and  no  platoon  sampled  was  able  to  produce 
all  the  subjects  requested  because  of  other  demands. 

The  positive  outcome  of  the  present  research  Indicates  that  the 
N'atlonal  Cuard  would  accept  the  use  of  peer  evaluation  In  career  deci¬ 
sions.  This  result  should  not  be  generalised  too  far.  The  nature  of 
the  present  sample  (average  age  25,  education  post-high  school,  length 
of  service  over  two  years)  and  the  nature  of  Individual  Involvement  In 
the  Guard  would  preclude  Inferring  similar  attitudes  In  a  Regular  Army 
sample.  These  results  do  warrant  Investigation  of  the  acceptability  of 
associate  ratings  In  active  Army  combat  and  combat  support  units. 

While  demographic  characteristics  would  differ  markedly  from  those  of 
the  National  Guard,  group  structures  would  be  similar  enough  to 
hypothesize  acceptance  In  Regular  Army  settings. 

f 

SlhMARY 

O 

N'atlonal  Guardsmen  (N  -  79)  participated  in  an  associate  rating 
procedure  In  which  they  were  asked  to  rate  those  In  their  platoon  who 
were  best  and  worst  at  getting  the  job  done.  They  then  completed  the 
Unit  Associate  Rating  Questionnaire  (UARO)  which  sampled  attitudes 
about  the  value  and  acceptability  of  associate  evaluation  procedures, 
and  also  completed  a  biographic  survey.  Guardsmen  expressed  generally 
favorable  attitudes  about  associate  evaluation.  In  contrast  to  previous 
findings  In  officer  populations.  In  their  opinion,  associate  ratlnge 
were  based  on  enough  and  sufficiently  varied  experiences  with  other 
members  of  the  platoon  to  be  valuable  for  predicting  future  performance. 
While  the  Guardsmen  were  willing  to  accept  associate  ratings  as  part 
of  their  records,  they  were  neutral  with  respect  to  specific  uses  of 
the  rating  scores  In  career  decisions.  There  was  no  significant 
difference  between  attitudes  of  the  various  combat  and  combat  support 
units  In  the  sample.  The  use  of  associate  evaluation  as  a  career 
progression  tool  In  non-tralnlng  units  was  not  precluded  by  the  present 
findings,  and  merits  further  evaluative  Investigation. 


10  - 


REFERENCES 


Bolton,  W.  L.  An  application  of  constant  siaa  paired  comparison  tech¬ 
niques  to  peer  ratings  at  an  Army  ROTC  st—er  camp.  Unpublished 
master's  thesis ,  University  of  Tennessee  (Knoxville),  1971. 

Downev,  R.  C.  Associate  evaluations:  Nominations  va  ratings.  ARI 
Technical  Paper  253.  September  1974.  (AD  785  550) 

Downey,  R.  C.  Associate  evaluations:  Improving  field  acceptance.  ARI 
Research  Memorandum  75-5.  July  1975. 

Downey,  R.  C.  Associate  nominations  In  the  U.S.  Armv  officer  training 
environment:  The  Ranger  course.  ARI  Research  Problem  Review  76-8. 
October  1976. 

Downey,  R.  G.,  and  Duffy,  P.  J.  Varloua  methodological  approaches  to 
peer  evaluations.  Paper  presented  at  the  21at  Conference  on  the  Design 
of  Experiments  In  Armv  Research,  Development  and  Testing,  Washington, 

D.C.,  October  1975. 

Downey,  R.  G. ,  Med  land,  F.  F. ,  and  Yates,  L.  G.  Evaluation  of  a  peer 
rating  avstem  for  predicting  subsequent  promotion  of  senior  military 
officers.  ARI  Rasearch  Memorandum  76-7.  April  1976. 

Hollander,  E.  P.  The  reliability  of  peer  nominations  under  various 
conditions  of  administration.  Journal  of  Appllad  Psychology.  1957, 

41,  85-90. 


Mohr,  F. .  S.  Accept abl 11  tv  of  associate  ratings  at  branch  basic  schools. 
ARI  Tachnlcal  Paper  268.  October  1975.  (AD  A017  437). 


Table  A-2 


PROPORTION  OF  RESPONDENTS  CHOOSING 
EACH  RESPONSE  ALTERNATIVE 

ITEMS  15-16  UARQ 


Shouldn ' t 


Be  On 

One 

Until 

Indefi¬ 

Until 

Item  1*  : 

Record 

Year 

Promoted 

nitely 

Replaced 

IF  RATINGS  ARE  A 

PART 

OF 

YOUR  RECORD,  HOW 
FAVOR  ITS  QSET 

LONG 

DO 

20.2 

15.2 

16.5 

21.5 

26.6 

Item  10: 

Ent Ire 
Platoon 

Squad 

3  or  4 
Others 

One 

Other 

Work 

Alone 

HOW  MANY  MEMBERS  OF  YOUR 
PLATOON  DO  YOU  WORE 
CLOSELY  WITH  ? 

28.2 

30.8 

33.3 

3.8 

3.8 

